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Abstract: Stochastic inflation describes the global structure of the inflationary universe 
by modeling the super-Hubble dynamics as a system of matter fields coupled to gravity 
where the sub-Hubble field fluctuations induce a stochastic force into the equations of mo- 
tion. The super-Hubble dynamics are ultralocal, allowing us to neglect spatial derivatives 
and treat each Hubble patch as a separate universe. This provides a natural framework 
in which to discuss probabilities on the space of solutions and initial conditions. In this 
article we derive an evolution equation for this probability for an arbitrary class of mat- 
ter systems, including DBI and k-inflationary models, and discover equilibrium solutions 
that satisfy detailed balance. Our results are more general than those derived assuming 
slow roll or a quasi-de Sitter geometry, and so are directly applicable to models that do 
not satisfy the usual slow roll conditions. We discuss in general terms the conditions for 
eternal inflation to set in, and we give explicit numerical solutions of highly stochastic, 
quasi-stationary trajectories in the relativistic DBI regime. Finally, we show that the 
probability for stochastic/thermal tunneling can be significantly enhanced relative to the 
Hawking- Moss instanton result due to relativistic DBI effects. 
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1. Introduction 



The great success of the inflationary paradigm has given impetus to each of the areas of 
physics upon which it touches. Its essential character, though, is captured by the dy- 
namics of a scalar degree of freedom that sources gravity in such a way as to generate 
an accelerating expansion rate for the Universe. The basic predictions of inflation require 
only an understanding of the classical dynamics of a scalar field in the overdamped limit. 
Though simple, meeting this requirement has launched a thousand models and remains an 
active area of research. Theoretical discrimination among models is difficult to achieve, 
particularly when some models possess exotic features like non-standard kinetic terms. 
Even within models, it is difficult to say with certainty whether particular inflationary 
trajectories are natural or contrived. 

It is no easy task to find an approach general enough to encompass the wide variety 
of inflationary models that still provides useful insight into inflationary dynamics. One 
way forward comes from taking a statistical approach, a technique that goes under the 
name of stochastic inflation. Pioneered by Starobinsky ^ , stochastic inflation treats sub- 
Hubble scalar field fiuctuations as a stochastic source of noise for the mean value of the field 
coarse-grained over a Hubble volume. The noise crosses the horizon during the inflationary 
expansion, allowing it to influence the super-Hubble behavior of the field. Studying this 
interplay allows us to determine the evolution of probability density for particular solutions 
to the field equations, a necessary first step towards understanding which infiationary 
trajectories are likely and which are not. 

There has been a great deal of work done applying Starobinsky's methods to a variety 
of infiationary scenarios and in understanding other stochastic effects for inflationary fields 
II, I, I, I, I, g, I . Readers interested in a review of stochastic techniques and applica- 
tions are referred to Some recent progress includes finding an analog of Starobinsky's 
celebrated Fokker-Planck equation for Dirac-Born-Infeld (DBI) inflation in Ref. |Tl| ; 
also, probabilities and stationary solutions in k-inflation [jl2| were studied in Ref. [|^. In 
this work, we describe general techniques that capture the stochastic behavior of inflating 
fields without relying on slow roll. This allows us to treat either exotic DBI or k-essence 
fields and canonical fields within a unified framework. 

To make clear what reductions of the full dynamics we make, we shall initially for- 
mulate the stochastic system on the full phase space. There are two ways in which the 
coarse-graining between super-Hubble and sub-Hubble modes can be achieved, which we 
refer to as the one- and two-noise approaches. In the one-noise approach, the stochastic 
noise is viewed as an additional force in the classical equations of motion, so that the 
momentum receives kicks, but the time derivative of the field is related to the momentum 
according to its classical equation. In the two-noise approach both the field and momentum 
receive stochastic kicks. The two approaches are qualitatively (although not identically) 
the same. The two-noise approach has the advantage that if the sub-Hubble perturbations 
are assumed to be adiabatic, then it is equivalent to the stochastic Hamilton-Jacobi ap- 
proach considered in Ref. [0] after a phase space transformation. A disadvantage to this 
approach is that when applied to models such as DBI infiation in which the scalar has 
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a speed limit, stochastic jumps will typically violate this limit, even though on average 
it is satisfied. By contrast, the speed limit continues to be satisfied even with stochastic 
fluctuations included in the one-noise approach. 

In the two-noise case we can find a one parameter family of equilibrium solutions which 
satisfy detailed balance. This additional parameter is a reflection of the fact that the solu- 
tions retain a partial memory of their initial state. This is the same parameter that arises as 
the integration constant in solving the Hamilton-Jacobi equation, so it is fixed by the initial 
conditions for the field and momentum. One of the most important reasons to understand 
whether equilibrium solutions exist in any model of infiation is to understand stochastic 
tunneling, i.e. tunneling described by the Hawking- Moss instanton |14|. If the infiationary 
potential has a variety of metastable minima for which the tunneling rate to other vacua is 
low, there is usually sufficient time for a partial equilibrium to set in before the field tunnels 
to the true vacuum. The equilibrium solutions we find through our stochastic approach 
allow us to derive the transition rates for thermally-activated/stochastic tunneling, thus 
generalizing the Hawking-Moss instanton result without making use of difficult to interpret 
Euclidean gravity techniques. Qualitatively, what we find is a transition amplitude similar 
to the usual one when Cs, the effective sound speed of the perturbations, is everywhere close 
to unity; however, in regions of phase space for which Cs <C 1, we find a significantly en- 
hanced tunneling rate. This is of significant interest in understanding tunneling in models 
of the so-called landscape of string theory (cf. |15, |l6|, 17, 18]). Furthermore, the tunneling 
rate, like the equilibrium solution, retains a partial memory of the initial probability state. 

One practical way to make use of our framework is to use it to give explicit solutions for 
stochastic inflationary trajectories. We did this for DBI inflation. In agreement with earlier 
results in [|ll|, we find that in a phenomenologically viable DBI model with only an m?'(fP' 
potential, eternal infiation is not possible, at least in the relativistic DBI regime. However, 
by adding higher order polynomial corrections to the potential, which are expected to kick 
in at large field values, we can find solutions that possess both a phenomenologically viable 
regime at small values of (j) and a stochastic DBI regime at large values of (j). Intriguingly, for 
certain initial conditions the evolution of (f) in this stochastic regime deviates strongly from 
its classical solution. The field undergoes an apparently metastable random walk, yet with 
Cs on average well below unity. This situation is quite different from the stochastic regimes 
encountered in minimally coupled models in that the relativistic "speed limit" , rather than 
Hubble damping, is setting the field's dynamics. Since brane infiation and other uses of the 
DBI action are still under active development, it will be important to determine whether 
regimes that exhibit these dynamics exist in fully worked out constructions. If they do, it 
will be necessary for stochastic dynamics to be taken into account when determining what 
inflationary trajectories are available and likely. 

Although our generalized stochastic approach does not provide any unambiguous mea- 
sure for inflation, it does allow us to state clearly the assumptions behind recent proposals 
for a measure. For instance, the phase space measure proposed by Gibbons and Turok |19| 
assumes that stochastic diffusion is absent from the scalar field evolution, and so including 
the stochastic noise tells us precisely how this measure will be adjusted when fiuctua- 
tions are included. We find that applying their classical arguments to DBI inflation gives 
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precisely the same e suppression. Alternatively, one can incorporate volume weighting 
into the Fokker-Planck equation, although this procedure is not manifestly gauge invariant. 
Recent proposals have attempted to improve on this (see e.g. ||2^, ^). 

We shall give a somewhat pedagogical discussion, emphasizing a number of standard 
results not often found together in the literature. For instance, we demonstrate that the 
stochastic approach requires neither a nearly de Sitter geometry nor a slowly rolling field, 
but only that the modes are exiting the horizon and the growing mode is dominant, and can 
be formulated in way that consistently incorporates gravitational backreaction. We begin 
in Sec. § with derivation methods for both the Langevin and Fokker-Planck equations. We 
emphasize the crucial role of the consistent ultralocal truncation of GR coupled to matter 
fields with its resulting scaling symmetry - which provides a natural definition of time 
through e-folds of volume increase. We apply these methods to DBI inflation in Sec. |2.4| . 
We then discuss several of the properties and consequences of the stochastic dynamics in 
Sec. m, including a general prescription for when quantum corrections come to dominate 
over classical ones - a necessary prerequisite for eternal inflation. In Sec. ^ we numerically 
calculate some explicit stochastic trajectories for DBI inflation. We focus on trajectories 
exhibiting strongly stochastic behaviour in a highly relativistic regime. Most intriguing is 
our discovery that apparently metastable ultra-relativistic random walks exist for super- 
Planckian field values. For these fields, the value of (j) does not systematically roll in any 
particular direction, yet the field's mean sound speed, c^, is well below unity. Finally, in 
Sec. ^, we calculate thermally-activated tunneling rates using our stochastic approach and 
demonstrate the above-mentioned enhancement in tunneling rate due to Cg < 1 effects. 
In Appendix A we demonstrate that the Hubble parameter is the generator of e-folding 
time-translations for ultralocal gravity and in Appendix B we give a formal path integral 
translation between the Langevin ( "equation of motion" ) and Fokker-Planck ( "conservation 
of probability density") approaches to stochastic dynamics. 

2. Phase Space Fokker-Planck Equation 
2.1 The importance of uhralocality 

A central ingredient to the stochastic approach is to consider the ultralocal limit of the 
action for general relativity coupled to matter fields. This limit is a consistent truncation of 
GR that arises when time derivatives dominate over spatial derivatives. This reduced phase 
space exhibits an important new feature: a scaling symmetry. This can be viewed as a time 
translation invariance in e-folding time. It is this symmetry that allows the conservation of 
curvature perturbations on super-horizon scales. Time translation invariance also permits 
us to develop a concept of detailed balance for the probability equations we subsequently 
derive. 

Following Salopek and Bond p2| , we describe the line element for our space-time 
in the Arnowitt-Deser-Misner form, 

= -N^df + -iij{dx' + N'dt){dx^ + N^dt) (2.1) 
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where N and Ni are the lapse and shift functions, and 'jij is a general three- metric. We 
consider the action for gravity coupled to a collection of non-minimal kinetic term scalar 
matter fields (pa (used here as a stand in for general matter fields) given by, 



S 



Mi 



+ p{X,cPa] 



(2.2) 



where p(X, (/>a) is a general scalar field Lagrangian and 



X = ^G"^ 



where ^^-^ R is the three-space curvature associated with , Gab is the metric on field space 
(a Kronecker delta for canonical scalar fields), Mp is the reduced Planck mass, and 



K.. 



1 
2N 



-Ni-j - Nj-i + 



dt 



K = Kl. 



It is useful to define scalar and gravitational momenta, 

G^^N~\^a - N'^a,i)p,x, = {Ml/2){K'^ - j'^K), 



IT 



(2.3) 



(2.4) 



where, for future convenience, these expressions differ from the standard definitions {pa) 
(e.g. 1^^) by a volume factor tTq = Pal In terms of these momenta, we can recast the 
action as 

(2.5) 



where the energy density 7i and a momentum density Tii are: 

p(Xo,(/>a) 



2 p^x{Xo,4>a) 



+ 

= 



M 



P (3)p I GabT^^T:^ , . GabTT^TT^ 

2 p^x{X,(pa) p^x{Xo,(Pa) 

2(7i^M''),fc+M%fc;^+vr'^'=0fe;i, 



+p(^l 



neglect as small 



and we have written tt'^ 
the relations 



X 



1 



G. 



Tr[7r'^]*-. Here X and Xq are implicitly defined by 



ab 2 



p\iX,(Pa) 



-G 



'ab , 



'^a;iYb ) 



1 vr^vr" 

2 p^^(Xo,(/>a) 



(2.6) 



We define X - the total kinetic term - and Xq - the temporal part of the kinetic term 
- so that the ultralocal limit is consistently applied to the nonstandard kinetic terms 
encompassed by the p{X, (p) formalism. The neglect of the terms in the large parenthesis 
is precisely the statement of ultralocality: the limit in which each point in space evolves 
independently of the points around it, as if it were its own separate universe. This is 
achieved here by neglecting all terms in the Hamiltonian which are second order or higher 
in spatial gradients. Crucially, this limit is not the same as the assumption of isotropy and 
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local homogeneity: the momentum constraint is untouched by this reduction of the problem 
and contains crucial information on how neighboring Hubble-patches are pieced together. 



In the special case of minimally coupled fields, Salopek |24] demonstrated that the reduced 
constraints 7i and 7ii still form a consistent constraint algebra, and thus represent a kind 
of contraction of the full diffeomorphism group that nevertheless includes the same number 
of generators. It is not hard to see that these statements generalize to gravity coupled to 
any matter system that respects general covariance, and in particular to the non-minimal 
kinetic models that we shall consider in this paper. Though we do not pursue this avenue 
at present, we wish to point out that the ultralocal limit retains superhorizon tensor mode 
dynamics. Since gravity waves, which are associated with this freedom, are not dependent 
on any potential, they simply give an additive contribution to the overall Hamiltonian, as 
seen above, and their dynamics are somewhat trivial even when stochastic fluctuations are 
included. For this reason they are usually neglected. 

2.1.1 Scaling Symmetry in the ultralocal Limit 

Once the terms in the large parenthesis have been neglected, we have a system that is 
invariant under the arbitrary scaling 

Hj e^^lij VTa TTa 

N' thus, S e^^S. (2.7) 

The crucial consequence of this symmetry is that the equations of motion are invariant 
under these transformations. In what follows, we will write -^77 — > e^'^, where A is the 
number of e- folds of expansion (counting forwards in time in an expanding universe). We 
shall find it convenient to use the number of e-folds as our time-coordinate. With this 
choice of time, the scaling symmetry mentioned here becomes, explicitly, a time translation 
invariance: the equations of motion for A + c are equivalent to those at A. Here we reap 
the first benefit of making the assumption of ultralocality. Given a field 0(A) that satisfies 
the equations of motion, then it automatically follows that (p{\ + c) satisfies the equations 
of motion. We will then be guaranteed that one perturbative mode will satisfy 

(^0a = 0a(A + c)-(/>a(A)oC^. (2.8) 

When we construct the (physical observable) curvature perturbation, arising from this 
mode, we find that it is conserved: 

C = ^ + = ^ ~ conserved! (2.9) 

dt dX 

where -0 = in our choice of gauge. The conservation of C is usually attributed to energy 



conservation for modes outside of the horizon |3C]; here, however, we can see that this 
conservation reflects the time translation invariance of super-Hubble modes. We can extend 
this linear argument to include non-linear effects in a straightforward way, and do so in 
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§ 2.1.2 . The constancy of one mode of ^ at linear order is generic; that is, there is always a 
curvature perturbation mode that is conserved outside the horizon. However, the existence 
of one constant mode does not mean that C is always conserved since entropy modes can 
mix into the constant part of C, and even temporarily dominate over the constant mode. 
This occurs, for example, for curvaton models [31|, or for multifield systems in collapsing 



spacetimes p2| . 

In what follows, we will consistently solve the temporal constraint equation TC = 0, 
thus removing it from consideration. In practice we achieve this by solving 7i = for 
TT\ = Tr{TT'^), and substituting back into the action. Combined with fixing the time- 
reparameterization invariance by choosing e-folding time, we are left with only the spatial 
constraint TCi and the associated spatial diffeomorphism invariance. However, ultralocality 
is precisely the statement that we do not consider spatial variations in the dynamical 
equations. Consequently, this constraint plays no role in the long wavelength dynamics, 
but only tells us how to stitch neighboring Hubble patches together consistently. 

From now on we shall work in e-folding time, in which it is straightforward to show 
that the dynamics of a set of fields (pa (not necessarily scalars) follows from an action of 
the form 

S= fdX f d^xe^^ ( TTa^ - H,J6a.7ra) - N'Hi 



dX '''' 

where the volume factor e^'^ has its origin in \/—g, and the momentum conjugates are 
defined, as before, without any dependence on this volume factor. To reiterate, this is the 
same action as in Eqn. ( |2.5D , rewritten using e-folding time, where we have explicitly solved 
for the constraint TC = 0. For brevity we have folded the tensor degrees of freedom into 
our single field variable, (pa = {4>a,Ji}- As we showed in Eqs. (^7?|), this action scales as 
S — > e^'^S under the shift symmetry, and so the equations of motion are correspondingly 
invariant. 

The equations of motion, given by 

d(l)a dHeq dl^a dHeq „ nj n 

— — ^ StTo, Hi = 0, 



dX d-Ka dX d(l)c_ 

take the form of a damped Hamiltonian system, and thus naturally split into a time re- 
versible part - which follows from the undamped time translation invariant action, 

which by itself would conserve //eq ^ and an irreversible part from the damping. The time 
reversal symmetry acts as A ^ —A, (pa £a<Pa, T^a —^a^^a (where ea = ±1 is the intrinsic 
time parity of the field (pa) and the Hamiltonian transforms as Hcq{(pa,'^a) = Hi,q{(pa, — vTq,). 
The loss of 'energy' through damping is given explicitly by 

= -3vr«^. 2.10 

oX OTTa 

To illustrate this, let us drop the spatial dependence and consider the canonical ex- 
ample of a minimally coupled scalar field and gravity whose dynamics is governed by the 
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homogeneous and isotropic (mini-superspace) action 



where a dot indicates differentiation with respect to an arbitrary time coordinate, t. If 
we vary with respect to the lapse function N to find the constraint equation, namely the 
Friedmann equation 

we can solve directly for the lapse function N: 



N = XMp, 




6M2 \dX 



Substituting this directly back into the action Eq. ( 2.11| ), we find 



S = j dXC = -2Mp J dXe 



3A 

^\ 

rev \ 




reversible 



This step effectively removes the residual diffeomorphism invariance from the system and 
reduces it to that of a non-minimally coupled damped scalar field system exhibiting the 
promised scaling symmetry. We have labeled the parts of the resulting action that are time 
reversible and time irrev(ersible). In this case the conjugate momentum is given by 



-3A d£ _ V{^) 



7r^ = e-^^^5— = (2.14) 



d\ J 



and so the equilibrium Hamiltonian is given by 




He^ = 7r^<i),x-e-'^C = 6M'p^-^ + ^. (2.15) 
One can demonstrate that the damped Hamiltonian equations given explicitly by 



dX Hpci dX Hp, 



'eq -'-'eq 

- when combined with the map from e-folding time to proper time NxdX = 6Mj,H-^dX = 
dt, are identical to the usual Friedmann equation and scalar field equation. It is also 
possible to reintroduce a spatial curvature term by making the replacement V V — ke~'^"^, 
although this clearly breaks the time translation invariance. 

A couple of comments about the form of this Hamiltonian are in order. Firstly, it 
resembles the Hamiltonian for a relativistic particle with mass m oc VV, which is a conse- 
quence of the fact that the mini-superspace action is equivalent to that of a particle moving 
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on a 1+1 dimensional manifold with space-time dependent mass. Secondly, remembering 
that the Hubble parameter is defined via H = X/N = 1/N\ and using the equation ( 2.12| ) 
for A'';^ we have 

Foq = 6M|,F. (2.16) 

This result is no coincidence, but rather a universal relationship, true for any system in 
which the the action for gravity is given by the Einstein-Hilbert action, which we demon- 
strate in Appendix A. Even from what we have already shown, it is clear that for a reversible 
system, H^q is conserved. This implies that the Hubble parameter, which is proportional 
to Heq, must also be constant. Thus, whenever a gravitational system arrives in a state 
governed by reversible dynamics, it will realize a de Sitter (H = const) background. The 
origin of the concept of eternal inflation is precisely that sub-Hubble stochastic fluctuations 
can on average balance the loss of energy though damping, giving rise to precisely such an 
equilibrium de Sitter-like state. 

2.1.2 Relationship with Hamilton-Jacobi approach and attractor dynamics 

It is illuminating to translate our approach into the related, but more familiar, Hamilton- 
Jacobi formulation. They are related by a phase space (but not canonical) transformation. 
The trick is to reexpress the momentum, vr^, as some function, fai4>a, Ja), of the field values 
(pa and new variables J^. The action then takes the form (neglecting spatial dependence) 

S = j dXe'^ (^/„(0^,j^)^_^,q(0^,j^)^ , (2.17) 

where Heqifpa-, Jo) = -f^eq T^a = fj{4'p-, Jp))- Varying with respect to (pa gives the equa- 
tion of motion 

dJn d fa „ dHpa 

-rf 777^ + 3/„ = -— ^. 2.18 

dX Ojj3 0(pa 

We can then simply choose = — | , which is the same as writing tTq, = — 2Mp^- 
since Heq = ^MpH. With this choice, the variables Jq are conserved quantities 

^ = 0. (2.19) 

The Hamilton-Jacobi equation can then be immediately inferred from the relationship 
between the equilibrium Hamiltonian and the Hubble constant. 



H{(Pa, Ja) = TrVJfHcq 4>a, -'^M'p— . (2.20) 



6M^ 

The Ja's arise as integration constants in this approach, and the Hamilton-Jacobi dynamics 
is encoded in the action 

.3A f o«^2 dH d(pa „,.2 



S= dXe-'^[ -2Mi- 7^ - 6MiH . (2.21) 

J V (y(Pa dx J 

The Hamilton-Jacobi approach allows us to derive a very powerful result: It is often 
of interest to know whether the dynamics on phase space is an attractor. Indeed, a crucial 
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argument in favor of inflation being insensitive to initial conditions is that it is an attractor. 
Since the parameter distinguishes between trajectories, let us consider the effect of a 
small variation in 



^ 6Mp d-Kfj,^ J \ d(pa J 3 dX 

l d6H{^f3,Jp) 
~ 3 dX ■ 

That is to say, 5H ~ e^^'^ for any system - a remarkably general result. The fact that 
slow roll solutions are usually attr actors has its origin in this very general argument, since 
if the effective equation of state of the background solutions is tt; < 1, then we have 

lim >0. (2.23) 

A-»oo H^x 

In the single field case this is sufficient to show that all solutions are attractors for one 
another that tend towards convergence in the asymptotic future. This does not imply the 
existence of a single "attractor solution," however. This general argument also breaks down 
in the presence of large fiuctuations |]25[| . In the multi- field case we must also consider vari- 
ations in H from isocurvature modes. Note that in the collapsing case the same argument 
shows that w > 1 solutions exhibit similar behavior for single field evolution, a well known 



similarity between these two scenarios [26|. 



Another use of the Hamilton-Jacobi form is to generalize the argument for the con- 
servation of adiabatic curvature modes outside of the horizon beyond the linear level seen 



in Eq. (p.9|). Following the arguments presented in [B^, 28], we can define a conserved 



differential perturbation for a single field through the identity 



O = ^-/f(0), (2.24) 



Ndt Ndt 

where H{(p) is the Hamilton-Jacobi function. Then we can integrate over time to find 



C = -A + J H{<P)dt 



which is nothing other than the integrated form of Eqn. (^.9|), which correctly behaves as 
— > + c under time translation. This definition is most useful when computing non- 
Gaussianity, where we are most interesting in correlators of since this is the conserved 
quantity at long wavelengths and is nonlinearly related to the fiuctuations of (j). 

2.2 Introducing probability through coarse-graining 

Let us return to the general equations of motion for a complete field, including both sub- 
and super-Hubble modes. Since our aim is to derive the field's stochastic dynamics, the 
task at hand is first to characterize the sub-Hubble modes. We can then coarse-grain over 
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a horizon patch to remove its particular dynamics and replace them with an averaged 
"noise" force acting on the super-Hubble field. This noise will characterize the influence 
of the sub-Hubble modes on the super-Hubble evolution of the field as those modes exit 
the horizon. But first, we must characterize the deterministic behavior within a horizon, 
where the ultralocal approximation is invalid. It is thus necessary that we retain spatial 
gradients for sub-Hubble modes. The complete system can be written as 

dSn SHea dlTcy SHea 
Ya _ eq a _ eq _ ^^^^ ^ ^ 



dX diTct dX 
Here the notation is such that 



Note that we have continued to retain the spatial diffeomorphism constraint (Tii = 0) 
since it is important at sub-Hubble scales, but the temporal constraint (7i = 0) does not 
enter since we have already explicitly solved for it. We can now divide the fields and their 
momenta into long and short wavelength parts. For any particular field (j)a we may write 

Using this split in the equations of motion, retaining nonlinearity for long wavelengths 
but taking the linear approximation for the short wavelengths, we find (suppressing, for 
notational simplicity, the indices related to field summations) 

— + r^^s - T — FT-'^S = 0, 



dX Sttl ' \^ dX (Jvrr 6'kl^4' 



'L 



vr^) + (^^^s + ^vrc,) = 0. (2.26) 

With this done, we can subsequently neglect the spatial variation of the long wavelength 
portion of the field (except in the constraint 'Hi{(t)L-, t^l) = 0), and trade (5 — > 5, but retain 
the spatial variation in the sub-Hubble modes. A more careful treatment which continues 
to use the spatial derivative information at long wavelengths - which can be useful in 



calculating non-Gaussianities - is considered in |29]. 

Having now split the field at this level, we need a prescription for precisely how the 
split is accomplished. We choose to split each field and its momentum at some particular 
scale, which will be a constant multiple of the sound horizon for an ordinary field, but 
which may be more complex in general. To remain general, we write 

(t>S = I J^eif{(t>L,7TL, X) - k)64>k, 7rs = J ^e(/(<AL, VTL, A) - k)67Tk (2.27) 



where we are free choose the function, f[(t>L-,T^L-,X). We have chosen to use a Heaviside 



window function (see Ref. |37| for alternative approaches) because it quite directly retains 



the Markovian^ character of the sub-Hubble noise as considered from super-Hubble scales. 

^Noise is said to be Markovian if its correlator {rj{X)rj[\')) is proportional to a delta function S{\ — A'). 
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It is clear from the Eqs. ( 2.26 ), that each (5</>fc mode of the field obeys the (linearized) 



equations of motion; and the short wavelength part of Eqs. ( 2.26| ) - inside the parenthesis 



- are exactly these equations of motion. Hence, the terms in the parenthesis vanish ev- 
erywhere except when f = k, where k is the horizon scale in the usual case. Thus, the 
derivatives turn Q into a 5— function and we can rewrite 



dX Sttl 

+ Sttl = ri^, (2.28) 



dX 6(t>L 

where the noise terms, r/^ and 7/,^ are given by: 

W = - / (03 ^^^%^^(/(^- A) - k)5^, , (2.29) 

V. = -l ^ '^^'^T^'^ W^L^-L,X)-k)5.,. (2.30) 

(2) 

Given this definition, one can calculate is the diffusion matrix, 2L'^^J(A— A') = {r]j\^{X)riB{X')). 
In general, these two noise terms are independent, since the field has two independent 
modes. However, we will typically assume growing mode domination outside of the hori- 
zon. This is equivalent to suppressing one of these modes and implicitly correlates the two 
noises; when this occurs, they cease to be independent. This subtlety does not impact our 
calculations. Inserting Eq. ( 2.29| ) and noticing immediately that the correlation between 



two mode functions with different momenta will vanish, we can suppress one momentum 
integration and write 

(^<^(A)r?^(A')) = I ^^^^6{ficPL,nL,X) - k)6ificP'L,nlX') - k){dMmki\')) 



(27r)3 dX 

471" / „2 4f(0L,7rL, A) 



^^, df{<p,^n,,X) ^ 5(A - X'm,=fiX)5^,=fiX')) 



(27r)2 

where we have made use of the properties of the delta function several times. Similar 
expressions can be found for D^?! and D^"^^ 



For the super-Hubble modes to be treated classically, it is crucial that the correlators 
of the noises commute. In practice, this requires 

([^0/(A),^c^;(AO]) 

{5cl,f{X)6ct>f{X')) ' ^ • ^ 

i.e. the ratio of the Schwinger commutator function to the Wightman function must tend to 
zero. This will occur whenever there is a clear definition of a growing mode. In cases where 
the equation of state w is not varying rapidly, the evolution of a given mode outside the 
horizon typically splits into a growing part and a decaying part, 6(/)k ~ Ae^'^ + Be'^'^ + . . ., 
with g > d. In this case, the ratio of the commutator to the Wightman function scales as 

{[6(l)f{X),5^f{X')]) _ Jd-g)AX(d-g)AX' 



{64>f{X)6<Pf{X')) 



g(d-gJAAg(d-3)AA ^ (2.32) 
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where AA is the number e-foldings through which a given mode has evolved since horizon 
crossing. Because of this exponential scaling, only a few e-folds are required for the noise to 
look classical unless (g — d) is particularly small. Of course, any coarse-graining prescription 
will cease to be valid whenever the modes begin to oscillate. This happens during reheating, 
for instance, when the mass of the field, not the Hubble constant, dominates the dynamics. 
However, let us stress that neither slow-roll nor a quasi-de Sitter geometry {w ~ —1) is 
crucial to the stochastic approach per se. All that is required is a clearly defined sound 
horizon (which usually implies dw/d\ <C 1), and that the super-Hubble dynamics can be 
treated ultralocally so that Hubble damping dominates over mass terms. It is true, however, 
that the quasi-de Sitter case is where these conditions are most easily satisfied. Let us also 
stress that there is no problem with treating the modes at super-Hubble scales while they 
remain slightly quantum, as is the case when it takes a large number of e-foldings for the 
growing mode to dominate over the decaying modes. In this case, we are just required to 
use a so-called quantum Langevin equation |43]. 

To proceed we must focus on a specific model, and here we shall consider the general 
class of single field models whose Lagrangian takes the form p{X, (j)) where the kinetic term 



given hy X = —hg'^'^(f>,n(f),i,. We can then appeal to the general perturbation calculations 



made in §8.3 of Ref. |33|. A crucial question is how the perturbations in our approach 
relate to the gauge invariant variables. As pointed out in Sec. this relation is in fact 
straightforward, since we have chosen a gauge in which the volume of spacelike surfaces 
is used to measure time, then in terms of standard cosmological perturbations this is the 
gauge in which the spatial metric perturbation ^ = 0. Thus 5(j)k = {(p/H). The equation 
for Cfc is of the form 

Clf + 2^Cfc + cffc2Cfe = 0, (2.33) 



where ' denotes conformal time derivative, and z = a\J {e + p)/ {cgH), and we have defined 
a sound speed for the field 

2 ^ P2X_ 

and energy density, e, given by e = 2Xp,x —p- The normalization is set by the Wronskian 

[CkCk - Ck'Ck) = -2i. (2.34) 
At super-Hubble scales the solution for the positive frequency mode looks like 

Cfc+ = Ak + Bkj ^ dr], (2.35) 

which represent the growing {A/.) and decaying (i?fc) modes. To determine these approxi- 
mately we may use the horizon crossing approximation, which is valid whenever the sound 
horizon is well defined {dln{c~^aH)/dX <C 1). The normalization of 64>k is given by 

g 1 



where g is a fudge factor of order 1 that reflects the inaccuracy of the horizon crossing 
approximation. We can fix this fudge factor by comparing with exactly solvable models 
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1 34], and in particular those that give scale-invariant spectra. Taking / = ^aH/cg, with 



^ <C 1 to ensure growing mode dominance, we obtain 

Given the Langevin equation, we can infer an equation for the evolution of the probabil- 
ity density on phase space using Appendix B, which takes the form of a Fokker-Planck 
equation. Here, we write the Fokker-Planck equation as a current conservation equation 

where J'a is the current and we are using a notation so that (j)A = {(pajT^a) represents any 
canonical coordinate. For a diffusion matrix given by Dab, the currents take the general 
form 

(dH \ d 

nAB^r^-JA^^B] P-Dabtt—P, (2.38) 
d(pA ) d(pA 

where ^ab is the symplectic form on phase space (which can easily be determined from any 

particular model's equations of motion) and ^ab is the damping term (for all inflationary 

systems, ^-k^^ = 36ab is the only nonzero damping term). In particular, for a single scalar 

field, we have 

dHcq 5P n ^-f^eq „ ^^P ^p 



dir^ ''''d(t> ""^^dTT^' del) " ^^'^d(t) "^"^Svr, 

(2.39) 

In writing these relations we have made a specific choice of operator ordering, which is 
connected with the precise measure in the path integral of Appendix B. It is common to 
consider the more general ordering of the diffusion term 

DABj^P^DAciQ-'f'^iQDBp), (2.40) 
d(l)A d<pA 

where for instance {Q)ab = for < /? < 1. This typically gives a sub-leading effect 
to the dynamics, so we choose /? = 0. The resulting ordering of terms is known as the Ito 
ordering; we further note that ref. [^5| argues that this prescription is the natural one for 
stochastic infiation. 

2.2.1 One-noise coarse-graining 

In the one-noise case the procedure is very similar. As before we split (pa = 4'a,L + 4'a,s, 
but now rather than splitting tt, we define iTa^L in terms of 4>a,L using the long wavelength 
equations. In other words the equation 



d(j)L SHeq 



dX Sttl 

remains exact without noise, so that r/^ = 0. We define 



0, (2.41) 



(fik 

(ps = / (^^(/('^i' ^) - k)Hk, (2.42) 
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where the window function now must be chosen differently to maintain a Markovian noise. 
As before the second equation includes a noise term 

(?7rr SHpQ , , , 

SO that the only nonzero Diffusion term is D^^ = ^(^/tt^tt)- 
2.3 Systems satisfying Detailed Balance 

The existence of an effective time-translation symmetry allows us to consider models which 
satisfy the principle of detailed balance. We choose to explore detailed balance because 
using it will give us a more intuitive understanding of de Sitter entropy as an equilibrium 
in the evolution of gravitationally coupled scalar field dynamics. The concept of de Sitter 
entropy is important enough that its appearance here, emerging from an approach quite 
different from its usual derivation, is worth comment. In the present context, the principle 
of detailed balance states that an equilibrium state should exist in which the loss of 'energy' 
(where energy is -ffeq) via damping is on average exactly compensated by the gain in energy 
from the small scale stochastic noise fluctuations. More precisely: for a discrete system 
with probabilities pn, detailed balance states that given the master equation 

^ = ^ {-rn^mPn + Tm^nPrn) , (2.44) 
m 

where Vn^rn denotes the transition rates between states n and m, in equilibrium we should 
have rn^mPn = fm—>nPm- Generalizing to a continuous system with probability distribution 
p, we replace the above with the probability current conservation equation ( |2.37 ). For a 



system that exhibits overall time translation invariance, the current may always be split 
into a reversible (even) and irreversible (odd) part 

Ja = JT + JT\ (2.45) 
where time reversal symmetry T (A ^ — A) acts as 

and, again, ca = ±1 is the intrinsic time parity of the field (p^. Note that tTq has the 
opposite time parity to (pa by definition. For a continuous system of even and odd variables, 
detailed balance amounts to the statement that, in equilibrium^, 



rev 



JT^ = Q and ^^^ = 0. (2.46) 

d(pA 

Schematically, we can see how this works out: the damping term and the diffusive noise 
contributions are both irreversible contributions. Consequently, for a detailed-balance equi- 
librium to form, they must exactly cancel each other out. 



^For a detailed discussion of the reason behind this the reader is encouraged to consult section 6.4 in 
Ref. isi. 
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To see how detailed balance can be implemented more concretely, let us focus on a 
single field system described by the conjugate variables 0, vr^. The reversible current is 
that determined by the reversible, or "equilibrium," Hamiltonian, Hcq. 



ijr,Ji7) = (^.. = [^^. -^pj . (2.47) 

The irreversible current contains two contributions, one from the damping current 

and a diffusive noise current that we expect to be of the form^ 

Jf"" = -Dab^T-- (2-49) 
In the one-noise approach, the diffusive current takes the simpler form 



(2.50) 



We are now ready to determine the consequences of assuming detailed balance. The 
general definition of an equilibrium state is d^J'J^^ = {p, H^q} = 0. This implies that 
Peq = F{Heq)- The detailed balance requirement, J'^^^^^ = 0, implies —Stt^p — Dt^J.^^-^^ = 
0, which fixes the diffusion parameter to be 

£)(!) = ^ (2 51) 

Thus detailed balance uniquely fixes the form of the Fokker-Planck equation down to 
the specification of a single function, the equilibrium distribution pcq = F{Heq). Once 
we have reached this state, though, we can take guidance from the fluctuation theorem 



| 38|] . It tells us that, in equilibrium, the probability must be given by peq = exp5ent, 
where Sent is the entropy of the equilibrium configuration. Now, in any system in which 
gravity is given by the Einstein action we know that that H^q = 6MpH where H is the 
Hubble parameter. Thus, all that is required for a complete specification of the system is 
a definition of the entropy of the system as a function of the Hubble parameter. There 
is, of course, a natural definition of this entropy: the horizon entropy in a de Sitter space 
background, 5ent = Svr^Mpff"^. Thus, the natural choice of equilibrium distribution is 
Peq = exp{87r'^ Mp{QMp)'^ H~q) . This fixes the diffusion parameter to be 

"^"^ 167r2M2(6M2)2^' 

Comparing with the result of the the coarse-graining calculation, this agrees only if = 1. 
Thus detailed balance is exactly satisfied for minimally coupled models, but in general is 



^This is the correct form of the diffusion current if the stochastic noise is Markovian and Gaussian 
according to the arguments given in Appendix B. 
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only approximately true in the region of phase space for which ~ 1. Nonetheless, it is 
remarkable that the de Sitter entropy prescription - p ~ e"^ - drops out so naturally from 
this line of argument. Viewed in this light, the entropy of de Sitter space is a fixed point 
of a Fokker-Planck evolution that can begin very far from equilibrium. Since equilibria 
and maximal entropy are naturally related thermodynamic concepts, this approach to de 
Sitter entropy is considerably easier to grasp, intuitively, than the usual coarse-graining 
derivation. 

2.3.1 Generalizing to Two-Noises 

In the previous section, we used detailed balance and the assumption of a single noise 
acting on the field's momentum to derive an ansatz equilibrium distribution function. It 
turns out to often be nicer to work in a more general system where we retain noise-driven 
diffusion in both the (j) and vr^ directions, so we will generalize our results to this case. 



As we showed in section 2.1, the existence of a scaling symmetry guarantees that a 
solution to the perturbed equations of motion exists that satisfies the adiabaticity condition 

5<t>. 5.^ ^2.53) 



Assuming that this solution is the dominant growing mode, the diffusion terms appearing 
in the Fokker-Planck equation will be related by 

(j^{2) (2) (2) \ _ ( d^d^ d^d^ djTad^\ . . 

(,^</,.0,'^0..,'^-.-,; -y^X dX' dX dA ' dX dX J ' ^ ^ ^ 

Now, we shall check to see that the currents in the (j) and vr^ directions vanish in equilibrium. 
We find 



\ \ cLX / / 

(2.55) 

Following the same reasoning for J.,^^ , we find (under the assumption of adiabaticity) 

d\ 

Thus, there must exist an equilibrium state in which Ja = identically! This is the 
statement of detailed balance in a system whose degrees of freedom are neither even nor 
odd under time parity. 

The vanishing of the current implies that F satisfies 

Since this is only a single differential equation, modulo obstructions, one can basically 
always find equilibrium solutions provided they are normalizable. This is not of the same 
form as in the one-noise case, but it is easy to demonstrate that 
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is identical in both the one- and two-noise cases. In the two-noise case, any equilibrium 
distribution related to the diffusion constant in this way is consistent with detailed balance. 
However, in the two- noise case there is no a priori reason that peq should only be a function 
of Heq, and in particular we shall find that for 7^ 1 it cannot retain this simple form in 
general. 



2.4 DBI Inflation 

A natural application of our present results is to give a stochastic description of DBI 
inflation. In this case, inflation is driven by a scalar field with a non-canonical kinetic term. 
Our previous discussions were sufficiently general to encompass this case. To specialize to 
DBI requires only a quick calculation of H^^^ {(j),!^^) to describe the full dynamics. We 
will make an explicit calculation to demonstrate this. 
The action for DBI inflation is 

S = j d'x^g {^^R - -^Vl + /('^)(W + - y{<t^)) (2.59) 

We have absorbed any conformal couplings into a field redefinition and so are working in 
Einstein frame. The mini-superspace form of this action is 



S 



and so after solving for N and substituting back in as before we find the equilibrium 
Hamiltonian, Hgq = 6MpH, given by 

= l2Ml (/-I -r' + v). (2.61) 

So the reversible currents for DBI inflation are 

= (2^62) 



When we solve these equations numerically in Sec. ^ we will work in the one-noise formu- 
lation. In that case, there is only one diffusion parameter, Dt^^j^^. An explicit calculation 
gives the DBI diffusion parameter to be 

(1) _ 9M| 4 
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2.4.1 Comparison with previous work 

In the previous work described in Ref. a stochastic equation for DBI was derived using 
the Hamilton-Jacobi approach. Here we show that our two-noise formulation with the 
assumption of adiabaticity is completely equivalent to the Hamilton-Jacobi formulation. 
To prove this, let us begin with the two-noise Langevin system for a single field 

As in Sec. p. 1.2 we perform a change of variables tTq = fa{(t^p-, Jp) so that we have 



d-Kg ^ d(/)a _ dj£ 

dx ~ ^'^'^ dx ~ ^"'^^ dx ■ 



If the noise is adiabatic, then 



for both the classical and quantum parts, so the same choice of function /q, = — 2Mp^- 
as before implies that the equation 

dJg _ 
dX " ' 

is true both classically and with noise included. Here we see that the assumption of 
adiabaticity is a crucial ingredient, since Jq, represents the decaying (non-adiabatic) mode 
of the perturbations and the presence of any non-adiabaticity would give kicks to Jq even 
if classically it is conserved. Explicitly then, for single-field DBI the remaining stochastic 
equation is 



2Mlc,H, 



with (ri^r,^) = 21?;^; = FV(4^^), and 



dX H 

)(2) _ tt2 I(aJ1\ 



1 



1 + amUh, 



This is equivalent to the equation in |11] converted to e- folding time. The choice of which 
formalism to use is one of convenience. It is generally difficult to solve the Hamilton- 
Jacobi equation and retain the dependence on J; for this reason, we shall concentrate on 
the phase space approach for our numerical solutions. A second reason for concentrating 
on the one-noise approach for numerics, is that as described in the introduction, the DBI 
speed limit d(j)/dt < l/vT is in general violated in the full two-noise/Hamilton-Jacobi 
stochastic dynamics. However, the Hamilton-Jacobi version has the advantage of allowing 
us to give explicit equilibrium solutions (at least formal ones, written in terms of H{(j), J)), 
and is also useful in understanding tunneling. 
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2.4.2 Equilibrium solutions 



The equivalence between the two-noise and Hamilton-Jacobi approaches allows us to find 
simple equilibrium solutions which satisfy detailed balance. The Fokker-Planck equation 
(in which J derivatives drop out) in Hamilton-Jacobi form is 

dp ^ d ( 2MlcsH^^^ Q 



This has explicit solutions 

Pcq = exp ( - / # — 1 . (2.67) 

For Cs = 1 this gives the standard e'^'="* solutions. Strictly speaking we should check that 
these solutions are normalizable, but this is essentially guaranteed if H has a nonzero 
minimum, as is necessary to continue to coarse-grain over Hubble size volumes, and if we 
impose an upper boundary in (j) space, as is required to ensure the validity of effective field 
theory. We stress again that this is in fact a 1-parameter family of solutions since H has an 
implicit dependence on J. This freedom is a reflection of the fact that because there is no 
noise acting in the J direction, there is nothing to bring the J dependence to equilibrium. 
In practice adiabaticity is not exactly true, and so we can imagine that a more unique 
solution would arise, but it would take much longer for an equilibrium to set in for the 
dynamics of J in comparison with those of (j). 

In Sec. ^ we shall make use of these equilibrium solutions to understand tunneling. 
For now we merely point out that, whilst the peak of the equilibrium distribution is where 
H^^ = where = 1, the width of the distribution will be significantly wider if ^ 1 
away from this peak. In particular in the ultra-relativistic limit we have 

Peq = expf-y # ^^37, J, (2.68) 

away from the maximum. Note that for / ~ and V (jP' have In oc In (j). Thus 
for smaller D-brane tensions, the distribution will be broader. 



3. Properties of the Fokker-Planck Equation 

3.1 Condition for Classicality versus Eternal Inflation 

Stochastic noise arises fundamentally from small scale quantum fluctuations which appear 
classical at super-Hubble scales. The large scale evolution is predominantly classical as long 
as the average effect of the noise is smaller than the classical evolution. The regime in which 
the noise becomes comparable to the damping is the regime of onset of eternal inflation. 
There, quantum corrections are large enough to overwhelm the classical trajectory, leading 
to a potentially unlimited period of inflation. 



-20- 



We can give a simple prescription for the onset of the eternally inflating regime by 
looking at the Langevin equation for the Hamiltonian (or equivalently Hubble constant). 
Its evolution is given by 

where 7^ is a generalization of the damping parameter. The rate of energy loss due to 
damping (the classical part) dominates the noise (the quantum part) whenever 

7l0B^V > I^AB^^. (3.2) 



In either the one or two-noise approach - we have 

B I dHeq dHeq dHeq d/Sgnt o\ 

^^(I^B^r— = Dab ^ . ^ , c,— — , 3.3 

d(l)A 0(t)A d4>B dHeq 

where the de Sitter entropy is ^ent = Sn^M^H"^ = Sn^ Mj,{6Mj>f / H^^, and so the 
inequality takes the form 

dSent ( Bi dHcq\ 1 , , 

-TFT- ^A'PB^^ > — , 3.4) 

dHeq V d(l)A ) Cs 

which is essentially equivalent to 

—77- > — > (3.5) 

aA Cs 

reducing for minimal kinetic term models to the intriguing result > 1. For the 

evolution of a system to remain classical, its change in entropy per e-fold must be greater 



than unity or even larger. This result is consistent with that derived in |3£], where more 



general arguments were given based on the null energy condition. It demonstrates that it 



is much easier to achieve eternal inflation for small values of Cg, as seen also in [|T^. In |39| 
this was used as an argument to say that there are a maximum number of e-folds possible 
before reaching an eternally inflating regime, given by A^max = c<j5ent- 
For the specific case of DBI inflation this condition amounts to 

fH^ < 1, (3.6) 

which in the regimes of most interest is fV'^/Mp < 1. In the simple scenario considered 
in Ref. / ~ l/f/*^ and 1/ ~ c/)^ and so this ratio is constant. If it is fixed by the 
requirement of giving phenomenologically acceptable inflation, then its magnitude is lO"^'^ 
and so these authors concluded that it was impossible to achieve eternal inflation. It is 
clear that this result arises from an accidental relationship between / and V which is highly 
model dependent. It seems unlikely that as new models are developed this coincidence 
shall remain. In Sec. |^ we get around this by assuming that the potential is modified, as 
is expected, at large field values, and in particular take V ^ cp'^. With such a choice, if 
(j) increases by a factor of 300, this is sufficient to cancel the lO"^'^ factor and reach an 
eternally inflating regime. 
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3.2 Large Damping versus ultra-relativistic Limit 

The system is strongly damped when the damping term, — Svr,^, dominates over time deriva- 
tive of the momentum, dn^/dX. This hmit is most straightforward to understand in the 
two-noise/Hamilton- Jacobi approach. Defining a damping parameter 70 = 3, the momen- 
tum is given by vr^ = —-^f-^^^- Taking the large 70 limit is equivalent to sending tt^ to 
zero for fixed //eq- 

We can then expand in powers of 1/70, so that ^ V/{^Ml) and the Lan gevm 
equation becomes 

^ = -Mp- + ry,, (3.7) 

where now D^^ = 2^^jpr- Using the standard rules described in Appendix B, this gives 
rise to the Fokker-Planck equation, 

which is nothing but the familiar Starobinsky equation expressed in terms of e-folding time. 

On the other hand, the ultra-relativistic limit for DBI is the limit in which the tension 
of the D-brane becomes small, i.e. /((/>) becomes very large. In this limit we also have 

« V/{3Mp), since the kinetic term, for fixed vr^, tends to zero in this case. The 
ultra-relativistic Langevin equation is of the form 



^ = -sign(y^)W-^+r?<^, (3.9) 

with the same noise normalization as before. It is amusing to note that the highly damped 
and ultra-relativistic limits behave the same 

if f = 3y . In the case of the models 

considered in Sec. ^ this would be achieved with a pure \rr?^ potential whenever <^ <C 
h (since /((/>) = A/(02 _^ 52)2^)^ provided that A = 36^/(3m2M|,). Whilst this is not 
necessarily a realistic parameter regime, it nicely illustrates the fact that one can achieve 
nearly identical behavior in two very different regimes of phase space, or for two very 
different models. 

3.3 From e-folding to proper time 

Although we have made use of e-folding time throughout, it is often convenient and more 
familiar to work with proper time. It is in fact straightforward to perform the conversion, 
since dt = H^^dX = 6MpdX/ H^q. The equilibrium Hamiltonian governing evolution in 
proper time is given by H^^ = H^q/{12Mp), whereas the diffusion constants are redefined 
as 

°- = (^) °- <^-'»' 

so the proper time Fokker-Planck equation is given by = —q^, where JT^ is the current 
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Both of these probability distributions are conserved with respect to the same phase space 
measure 

d(f)AP= I I dcpadiTa p = 1- (3-12) 



3.4 Entropy and Irreversibility 

The Fokker-Planck equation is an irreversible equation. This means that whenever equi- 
librium solutions exist and are reachable, all solutions to the Fokker-Planck equation will 
approach them. Whether this solution is unique depends on the precise form of the equation 
as well as the specification of boundary conditions. For instance, when we impose no flux 
boundary conditions and there exists a detailed balance equilibrium solution, this solution 
will be a consistent final state for the system. In any event, the equation's irreversibil- 
ity can be demonstrated by proving the analogue of Boltzman's H-theorem. Defining the 
information entropy 

(j)adTTapln{p/pcq) = - j #A/0 ln(p/peq) , (3.13) 

where pcq is any equilibrium solution of the Fokker-Planck equation, then it is a textbook 
result |6| that 

dS f ^1. f dp /I 1 / / \\ P dpc 



/.,,(|a+U«--|^) (3.14) 



Dab (dp p dpcq\ f dp p dpcq 



dX 

p ydcpA PcqOCpAj yOCpB PeciOCpBj 

where the inequality follows from the fact that Dab is a positive semi-definite matrix which 
follows naturally from its definition as Dab = ^{vaVb)- In practice the entropy increases 
monotonically until p = pcq. It is straightforward to prove (for instance using the path 
integral formulation in Appendix B) from the Fokker-Planck equation that 

mZl^ = e^inPe. (3 16) 

where P{A B;X) is the probability (strictly speaking, probability density) to go from 
a state ^ to a state i? in a time A. Both of the above statements show that there is an 
irreversible flow towards the equilibrium conflguration, which is a maximal entropy (in the 
sense of S) state. The fluctuation theorem |Q implies that peq = exp S'ont where 5ent is 
the entropy of the system and in the case = 1 at least this is certainly consistent. 

3.5 Measure Issues 

One of the great hopes for the stochastic inflationary method is that it will give insight into 
what a natural measure on inflationary phase space should, without which it is very difficult 
to assess the predictivity or robustness of any of the numerous infiationary models that 
have been proposed. The Fokker-Planck equation that we have constructed is a probability 
evolution equation with suggestive equilibrium solutions, but these solutions do not, as they 
stand, constitute a measure. Indeed, in the usual case with c<j = 1 this certainly does not 
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provide a suitable measure for the initial conditions for inflation since it gives a probability 
distribution which is heavily peaked at the bottom of the lowest potential well, whereas 
to start inflation we need to start high up. Furthermore once an equilibrium has been 
reached, the probability of jumping up to the top of the hill is exponentially small (zero 
in the limit of true equilibrium). It is interesting to note that this old problem can be 
somewhat ameliorated by relativistic effects, since these typically broaden the distribution. 



3.5.1 Volume Weighting 

In formulating models of eternal inflation, it is common to weight solutions by their phys- 
ical volume. The physical reason is that the stochastic probability distribution we have 
considered so far describes physics averaged over one Hubble volume. However, as space 
expands the number of Hubble volumes increases and so a 'superobserver' would multiply 
the probability measure by the number of such Hubble volumes oc e^^H^. 



The implications of this are highly gauge dependent (see Ref. |44] for a discussion on 
this). In fact, if we use e-folds as are natural time variable, i.e. surfaces of constant volume 
defining time, then there is no meaningful effect of volume weighting. Consequently, it has 
been notoriously difficult to define volume weighting in a gauge invariant manner. This 
lack of gauge invariance is tied to the fact that no observer can actually observe all these 
different Hubble patches, and so there is no natural frame in which to address this question. 
We have nothing new to add to this issue here, and refer the reader two recent approaches 



|2C] and |21] at tackling this thorny question. 

The standard approach is to use proper time slices, and weight by exp {?,y Hdt). This 
can be incorporated into the proper time Fokker-Planck equation replacing it with 

%=m- {H))P - OaJ/", (3.17) 

where {H) is the average of H evaluated at proper time t. The volume weighting may 
also be incorporated into the Langevin approach by taking the appropriate averages as 



in Ref. [45, 46 1. Here, an implicit assumption has been made that proper time frame 
corresponding to different Hubble patches are equivalent. The resulting equation is nonlocal 
in time, and thus loses many of its nice properties. In particular, there is no guarantee 
that the entropy S always increases. However, one can get around this by working with 
the non-normalized distribution p which satisfies the local equation 

^ = 3Hp-dAJt'', (3.18) 

with J'j^ expressed in terms of p, and then calculate at the end 

J dcpAP 

Unlike p, p has obvious irreversibility properties, but these are manifest with respect to a 
different inner product. Working in the Hamilton-Jacobi version, for example, this equation 
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is easiest to interpret by transforming it into a Schrodinger like equation by defining p 
exp i— d4>— — — ^ j X) with x satisfying (with f3 = 1/2 ordering) 



dt ^ 



X, (3.20) 



where 



Veff = -SH + + -— {2M],CsH^) . (3.21) 



It is apparent that the volume weighting term adds a negative contribution to the potential. 
This comes to dominate precisely when the condition CgdSerit/dX < 1 is satsified (at least 
compared to the second term in V^//), i.e. at the same time that quantum corrections kick 
in. The equilibrium distribution for p will be the solution for x that falls of as e"*^*, with 
the smallest value of k dominating. In other words, this will be the minimum eigenvalue of 
the operator K. Intuitively, this equilibrium probability distribution will be peaked near 
the minimum value of Veff, and so correspondingly will be set by the maximum of H. 
In other words, the equilibrium distribution will be peaked at large values of the field <j) 
precisely at the cutoff of the effective field theory. For the case of k-inflation, a similar 
conclusion was found in Ref. fPc 



3.5.2 Phase space Measures 

Ref. fl^] proposed the use of a pure phase space measure on the inflationary system - 
which in their analysis consists of a scalar field coupled to gravity in a mini-superspace 
approximation (for a related phase space discussion in the context of brane inflation see 
Ref. ^^). The phase space considered is the true phase space {(l),p^) defined on the 
constrained surface = by the symplectic two-form 

n = dcj) A dp^ + dX A d-nx = # A d (e^^vr^) - dX A d (e^^Feq) (3.22) 

which is conserved by the equations of motion. This is to be contrasted with the equilibrium 
phase space we have used in this paper in which the volume factors are taken out 

Oeq = d(f)A diT^ - dXA dHeq, (3.23) 

which is not conserved by the equations of motion, hence the presence of the damping 
terms. However, in the eternally inflating regime, when an equilibrium sets in in which 
the energy lost through damping is input through the noise, it is Ogq that is essentially 
conserved. 

The authors of Ref. |^] assume a constant probability measure on this phase space 
which, in the context of the present language, amounts to assuming p = constant x e^''* 
and neglecting the diffusion terms in the Fokker-Planck equation. The phase space is 
infinite, in general, and so the authors impose a cut off for low spatial curvature, arguing 
that universes with very small spatial curvature cannot be observationally distinguished. 
Having constructed a Hamiltonian formalism similar to the one we have outlined, they 
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propose to measure the phase space by analysis of the flux density of classical scalar field 
trajectories passing through a particular hypersurface - the surface of constant H. They 
are then able to calculate what fraction of those slowly rolling classical trajectories which 
pass through this hypersurface near the end of inflation were slow-rolling throughout the 
N e-foldings of inflation that proceeded their passage through this hypersurface. Their 
conclusion is that the fraction of always slowly rolling trajectories is oc exp (— 3A^). That 
is, assuming a flat probability of a trajectory beginning at any point in phase space, the 
fraction of trajectories that will exhibit canonical slow-roll inflation is suppressed by a large 
exponential factor. 

The volume measure on phase space is given schematically by (though strictly speaking, 
one should carefully define the surface of integration as in fl^ ) 

dc/xf^TT^e^^)- j d<l)2Ml\H^^\e^^ ^ jdH2M^e^^. (3.24) 

If we have 6H = 6Hs on some late time surface, then e-folds earlier we had 5H = 
e^^SHs- Thus, if we choose to define our measure surface at the end of inflation as 
in Ref. [^], then their argument follows that the probability of e-folds of inflation is 
suppressed by e~^^. Whilst the validity of this argument depends on the assumptions that 
go into it, we see that it conclusions generalize essentially unchanged to completely general 
models, e.g. those with non-trivial kinetic terms. 

4. Numerical Simulation of Stochastic DBI 

A complete study of the stochastic behavior of DBI inflation would require us to solve the 
Fokker-Planck equation for a variety of parameter choices. However, we can gain consid- 
erable insight into the kinds of phenomenology that the addition of stochastic dynamics 
permits by looking at individual field trajectories for particular parameter choices. 

Before describing these results, a brief note on the numerical methods we use. We 
solve the Langevin equations for the DBI system using a standard fourth order Runge- 
Kutta integrator. We solve the system both with and without the noise term included. 
The code adapts the Runge-Kutta step size to keep the evolution of the classical (no noise) 
solution well behaved. We refer to Ref. |^] for a discussion on solving Langevin systems. 
Since we will be dealing with Planckian field values, we solve the equations using variables 
measured in units of Mp (to simplify the formulae, we write the dimensionless Hamiltonian, 
Heq = {Heq/Vl2Mp)). Throughout the discussion of our numerical methods, tildes will 
denote dimensionless quantities. 

To treat the noise, we will us a one-noise formulation of the equations. For this 
numerical work, the one-noise formulation is superior because, by allowing noise only in the 
field's momentum direction, it implicitly enforces the DBI "speed limit", \d(j)/dt\ < l/vT- 
Allowing fluctuations in the field value itself leads to many apparent temporary violations of 
the "speed limit," making those results harder to interpret. We have done the calculations 
in both one- and two-noise cases, nonetheless, and find qualitative agreement between 
trajectories derived using both approaches in the same regions of parameter space. We 
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expect that these results would harmonize exactly upon averaging, as would implicitly be 
done if we were to solve the Fokker-Planck equation directly. For our single-noise treatment 
we normalize the diffusive force term such that 

iv^.V^,) = 2DW., = (4-1) 



Recall that, in the DBI framework, 



7 ^l + /(0)7r2' 



where /(</>) is the inverse tension of the D-brane, given by a function of the form 

A 



f{4>) 



where A and b are parameters which can be tuned within the model to match with data. 
Typically A is quite large, and in brane inflation set-ups is proportional to the number 
of fluxes present in the Calabi-Yau background. The so-called mass gap parameter, b, is 
related to physics towards the bottom of the inflationary throat. For more details on the 
string theory behind these parameters, see e.g. The standard DBI potential is given 

by 



V{(t>) = -m^r + K 1 



2 " \ A-nv 

For our numerical calculations, we use a standard Gaussian deviates generator with a 
variance given by -Dtt^tt^ to draw the stochastic force once per time step. We assume the 
noise force is constant during this time step and apply it equally to each of the Runge-Kutta 
sub-steps. 

We present here two parameter regions of interest. In the first, we do not attempt to 
find phenomenologically viable inflationary solutions, but merely wish to explore behavior 
available to a scalar undergoing stochastic evolution in an effective field theory described 
by the DBI action. In this spirit, we decided to see what sorts of behavior we could obtain 
using only sub-Planckian values for all parameters and for the field itself. We selected 
the parameters by noticing that strongly stochastic behavior that is also highly relativistic 
requires, essentially, 

r2 



^eq> V/''('^)' ^0^V/"'('^)' (4.2) 

where the first inequality ensures strong diffusion, while the second guarantees < 1. We 
show some typical results for these sorts of parameters in Fig. |l[ 



We chose our second set of parameters by comparison with Ref. |4C], a phenomeno- 
logical study of what parameter ranges for brane inflationary DBI match the data from 
WMAP. Most of the parameter sets described there had some interesting regions of behav- 
ior - we were able to see standard chaotic inflation set in at the appropriate fleld values, for 
instance. But since we are more interested in finding instructive new stochastic phenomena 
than in working out WMAP phenomenology, we chose to plot a related parameter set that 
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standard parameters: m = 0.4 A^SxlO* b = 0.2 V^^IQ-'' 




-0.8 -0.6 -0.4 -0.2 



0/Mp 




500 1000 



A 

Figure 1: Our standard parameter set is m = OAMpA = 5 x 10^, b = 0.2Mp, Vo = 10~^Mp, and 
V = 10''' . Upper panel: the evolution of the sound speed over the range between = — 0.8Mp and 
0. The classical (noise free) results are overplotted in colors, while the stochastic results are plotted 
behind the classical trajectories in black. Note that the stochastic results have been artificially 
thinned for readability; not every time step is plotted. In all these cases, the stochastic solutions 
tracked the classical solutions. The dark blue (solid) line is the standard parameter set. Each of the 
other lines has only one changed parameter, green (long dash, dot): ni — 0.2Mp; red (long dash, 
short dash): A = 10"'; cyan (dotted): b — 0.0. Magenta (dashed): Vo — 0.01Af|, Lower panel: the 
location of the scalar as a function of e-folding time. The colors correspond to the same parameter 
combinations as in the upper panel. 



is not among those described in |Q, but which does reproduce the proper level of density 
perturbations for small field values. To achieve this, we have to take super-Planckian initial 
conditions for our field values. For large field values, we expect the first few terms in the 
DBI potential to be given by 

y(0) = ^mV + K(l + ^cA^-^^), (4.3) 

where the first term is the usual mass term, the (/>~^ is a Coulombic attraction term arising 
in brane inflation, and the (/>^ term is a first higher-order correction to the potential, which 
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we expect when dealing with such large field values. Our particular parameter choices are: 

m = 2.4 X IQ-^Mp A = 4 x 10^3 Vo = 2 x IQ-^Mf, 
H = 0.01 V = 10-^M|, b = 2.0 

which gives P{k) ~ 7 x 10~^A (m'^/Mp) ~ 10^"'^'^ for the part of the potential dominated 
by the leading term. In the small region dominated by the m'^cfP' potential we easily 
get as many as \/ K/Qi^^ ~ 10^ e-folds of infiation. For (f) ~ lOMp the supergravity 
approximation is valid if the string scale, rristring ^ 0.04Mp. It is in the regime (p ~ lOMp 
where we find strong stochastic effects. Some results are shown in Fig. |2[ 




1 10 
A 

Figure 2: The parameters for this plot are m = 2.4 x 10~*Mp, A = 4 x 10^^, Vo = 2 x 10"*Af|,, 
H = 0.01, V = IQ-'^Mj., h = 2.0. The initial value of the (t> field is (t>o = lOMp. The classical 
solution (without noise) is plotted as a blue dashed line. The stochastic solution is the black solid 
line, thinned as in Fig. 1. The logarithmic scale is used pedagogically, to expand the early time 
period so that the nature of the stochastic trajectory is more readily perceived by the eye. Upper 
panel: the speed of sound as a function of efolding time. The frequent spikes to values near one 
represent instances of the stochastic force bringing the field's momentum to values near or through 
zero. Lower panel: the evolution of the field away from its starting point as a function of efolding 
time. Notice the random walk behavior of the stochastic trajectory. 

The surprise of the results represented in Fig. ^ is that a randomly walking, appar- 
ently metastable, stochastic evolution is occurring where, classically, the field is undergoing 
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relativistic, characteristically DBI evolution. By contrast, in the previous example (Fig. 
H]), the stochastic trajectories remained quite close to their classical counterparts. For this 
to occur, the value of the tension (given by !//((/))) must be very low, so that the DBI 
"speed limit" is saturated even for numerically tiny momenta. When this occurs, though, 
the field's speed has such a small upper bound that it can change signs frequently un- 
der stochastic kicks, hence maintaining its stationary position. Interestingly, despite the 
frequent passes through zero momentum (and hence a sound speed of unity), the mean 
sound speed along the stochastic path is Cg ~ 0.63, very close to the sound speed along 
the classical trajectory. The existence of such trajectories is hard to interpret rigorously. 
Qualitatively, what they teach us is that the conspiracy of noise domination and a very 
small local speed limit can effectively eliminate the possibility of classical evolution for a 
DBI scalar field in regions of field-space where these conditions exist. The extreme nature 
of the parameters necessary to achieve this behavior, however, may simply indicate that 
such trajectories are unphysical. It would be interesting, though, nonetheless to attempt 
to understand them better, since if they could be realized they would constitute a kind of 
eternal inflation from which there could be no escape. 



5. Stochastic/Thermally- Activated Tunneling 

There are two types of tunneling processes that can occur in nature: thermally-activated 
tunneling, and quantum tunneling. Thermally-activated tunneling is a classical process 
whereby small scale noise fluctuations kick the field over the potential barrier so that it 
can roll down classically to the true minimum. In quantum tunneling, by contrast, the 
field emerges immediately in the new vacuum after following an instanton trajectory in 
Euclidean time. These processes coexist at finite temperature, with the system's energy 
determining which is dominant, and indeed both can be incorporated into the instan- 
ton framework. The stochastic description developed here is ideally suited to describe 
thermally-activated tunneling, giving an alternative justification for the Hawking-Moss 
instanton. By contrast, the standard stochastic formalism as currently described cannot 
describe quantum tunneling; that is, transitions described by Coleman-de Luccia instantons 
1 41]. For a broad based discussion of approaches to tunneling, see Ref. |49|, and for recent 



discussions of the relationship between the different tunneling processes see Refs. [^, ^ ]. 

Thermally- activated tunneling occurs via diffusion over a barrier (see Kramers |42| 
for the pioneering work on this). Let us imagine we have a metastable minimum at (f)i 
separated from a stable minimum at (pf via a potential barrier which is maximized at (pf 
The most straightforward way to calculate the tunneling rate is to use the path integral 
representation of the solution of the Fokker-Planck equation described in Appendix B. In 
particular, working with the Hamilton-Jacobi version, the probability (density) to go from 
to (j)f in e-folding time Aj is 

P(A - ^ D, e.p [-£■ (* + 2M|f§*)n ,5.1) 



-30- 



exp (^-87r2 J^' d^Mj,^^ ] x (5.2) 



exp <; - / dX^ I ( + (2Mj,-'"' 




dXj \ H 

As usual we can perform a saddle-point approximation, where the classical trajectories are 
solutions to 

where is a conserved 'energy' variable. In general the solutions to this equation are 
unstable due to the negative potential, but the unstable one have much larger 'action' 



(where by action we means the expression in the path integral and are consequently 

much less probable. The unstable trajectories are those allowed by thermal kicks and allow 
the field to roll up the hill, whereas the usual trajectories that satisfy the classical equations 
of motion contribute to the probability with unit measure. 

It is easy to demonstrate that the minimum action trajectory corresponds to -E = 0, 
which means that the trajectories that go from (pi to (f)t evolve according to the e-folding 
time reversed equations of motion 



This means that these trajectories are repellers by the argument of Sec. p. 1.2 , i.e. 6H ~ e 



p3A 



Ignoring fluctuation determinant factors, the tunneling rate (measured per e-folding time) 
is given approximately by 



r/#i2M2£-. 



■ exp ( -Svr^ / d(l)Mp 



(5.5) 



Thus the exponential suppression comes entirely from the part of the path with H^^ > 0. 
This path is classically forbidden in the absence of fluctuations, so in this region we find 

For Cs = 1 this is exactly the standard Hawking- Moss result T ~ exp (S'ent (</>*) — 5'ent(';^t))- 
It is clear that if <C 1 in the region between and (jjt the argument of the exponential is 
significantly enhanced. In particular, in the ultra-relativistic limit Cg ~ l/(2Mp/-^/^|//^(^|) 
and so 

As we increase the number of fluxes A, thus sending the tension T = 1/ f towards zero, the 
exponential suppression tends to unity, implying that thermal tunneling can be significantly 
enhanced in the relativistic regime. A similar effect was found in Ref. pT] with regards to 
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quantum tunneling, albeit through a very different mechanism and with a very different 
quantitative form. 

There is a second way to get this result which follows more closely the original ar- 
guments in [^]. The key point is that if the tunneling rate is low, then there is usually 
sufficient time for an approximate equilibrium to set in for the field in the metastable well. 
Thus the probability density will be given approximately by the equilibrium configuration 
found earlier. The rate is then given by F = Jcf, / Peci{(t>i) ■ A simple calculation along the 
lines of Sec. 5.10.1 in Ref. |Q shows that the fiux is dominated by pe^i't't), and so we 
have 

r-^, (5.8) 

Pcq[(Pi) 

which is the same result. 

It is crucial to stress that this formula for the tunneling rate depends on the variable J 
implicitly though the Hamilton- Jacobi function H{(j), J). Thus the tunneling rate retains a 
memory of the initial state which has not been washed out by stochastic fluctuations. Since 
the trajectories that go up the potential barrier are repellers, this can have a significant 
effect on the tunneling rate. 

Note that the above path integral derivation can easily be extended to tunneling over 
multiple barriers with the total probability being suppressed by the product of the expo- 
nential suppressions for tunneling to the bottom and top of each barrier. 



6. Summary 

Recent progress toward building phenomenologically viable inflationary models in string 
theory has many consequences, chief among them the need to grapple with the landscape 
of vacua. Together with the rise in popularity of other non-standard inflationary models, 
the time is ripe to reconsider some of the standard techniques used in exploring the full 
implications of inflation. In this article we review some the salient features of the stochastic 
inflationary framework, taking a very general, model independent approach. Using our 
formalism, we specialize to non-minimal kinetic models such as DBI inflation that appear 
naturally in a stringy framework. We use this as an example of the concrete uses of our 
formalism, and were able to discover novel stochastic behavior for DBI inflation. By solving 
the stochastic dynamics numerically, we have found that metastable equilibrium states can 
exist in which the fleld is trapped by quantum corrections at some fixed value. We also 
find that the rate for Hawking-Moss type thermal tunneling can be significantly enhanced 
in regions of phase space where relativistic DBI effects are important. 
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A. Hubble Parameter as Equilibrium Hamiltonian 

Consider an arbitrary system of matter fields 0^ coupled to Einstein-Hilbert gravity 

S = j d^X^ QM|,ii + £A/(<Aa, 5^<^a, 9/..)) . (A.l) 

In the mini-superspace approximation this reduces to (for fixed comoving volume) 

S = ldtL = l Ndte'' (^-3Mp^ + A/ (^^^ ^^)) • (A-2) 

Defining the canonical conjugate with the inverse volume factor 

^^ = e-^>^^^ = -6Ml,^ = -6Ml,H, vr. = e'^^^ .^^ , (A.3) 
d{X/N) "^N P ^ 4>. d{(t>a/N) ^ ' 

so that the action can be re-expressed as 

S = J dte^^ (^TTxX + TT^Ja- Nn{(l)a,TT^^,Trx)y (A.4) 

Solving the Hamiltonian constraint 7i = for ttx and substituting back in gives the reduced 
phase space action expressed in e-folding time 

S = /^Ae^^^vr^^^ + TT,), (A.5) 

where the momenta are now implicitly evaluated on the constraint surface. This is exactly 
of the general scaling form where we identify H^q = —ttx as the equilibrium Hamiltonian 



(generator of A translations). Thus in general H^q = QMpH. As apparent from Sec. 2.1.2 
this result is closely related to the fact that the Hamilton-Jacobi function is directly pro- 
portional to the Hubble parameter. 

B. General Relation between Langevin and Fokker-Planck Equations 

Consider a generalised phase space damped Langevin system described by the equations 

where ^Iab is the phase space symplectic form, is a generalization of the damping 
parameter, and r]A is the stochastic noise. If this noise is Markovian and Gaussian, we may 
always rewrite this equation in the form of a Fokker-Planck equation. This is facilitated by 
means of path integrals (see [43| for an excellent review of this). Since the noise is Gaussian 



with correlators 

(r?A(A)r?B(A')) = 2Dab5{^ - A'), (B.2) 
then the average of a physical quantity may be obtained from the path integral 

{O) = j Dr]AO{r^A)exp (^-^ j dX^AK^'^VB^ (B.3) 
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where K^^ is the inverse of Dab which we shall (temporarily) assume to be invertible. 



We can view equations B.l as defining the noise in terms of 0a and so change variables in 
the path integral to 

{O) = I D^aM O(0A)e-^^'^H^-^-^+--"^-)^"^(^-^-^+--"^-), (B.4) 
where M is the change of measure determinant which can be dealt with using the usual 



Fadeev- Popov ghosts [43|. This is a subleading effect that we can safely ignore in the 
present argument. This is closely connected with the ordering issue of the derivatives in 
the Fokker-Planck equation. At this point we can introduce auxiliary conjugate momenta 
P"^ (N.B. no relation to the tTq) and write 



j D^aDP^ 0{cpa) exp {i I dXP^ - ^AB^ + 7a^<^b) - J dXP^DABP""^ , 

= I D^PaDP^ 0{M exp J dX (^^^ - H{cI>a, P^)j ) , (B.5) 

where the enlarged phase space Hamiltonian is 

H{ct>A, P^) = P^ [^AB^ - 7A^0ij) - iP^'DABP''. (B.6) 

The Fokker-Planck equation is simply the Schrodinger equation associated with this path 
integral, obtained by the usual replacement Pa "^afj (modulo operator ordering is- 
sues), 

In the case where Dab is not invertible this result is still valid, and all that happens is that 
the Langevin equations that do not directly have noise sources give rise to delta functions 
which enforce the classical equations of motion in equation |B.5| . The above path integral 
representations far from being just a useful mathematical trick can be derived from first 
principles by coarse-graining the m-m/Schwinger-Keldysh path integral along the lines 
considered in the stochastic gravity approach [E2|; see also S]. 
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